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(3) Method and apparatus for smoothing out stepwise changes of field of view. 



@ A method of smoothing out stepwise changes 
of field of view between a first and a second 
field, in an observation system adapted to oper- 
ate between at least two fields of view, which 
observation system has picture acquisition 
means adapted to each field of view and display 
means for displaying the picture, comprises the 
steps of: a) selecting a reference point in the 
picture to be observed in a first field of view ; b) 
digitizing the part of the picture appearing in 
the first field of view which it is desired to see 
after the step change, and transmitting the 
digitized data to data processing means ; c) 
processing the said digitized data to compress 
or expand each pixel by a factor equal to or less 
than about the difference between the fields of 
view, the said compression or expansion being 
carried out sequentially in a plurality of steps ; 
d) at each stage of the compression or expan- 
sion process, displaying the partially compres- 
sed or partially expanded picture, so as to 
create the feeling of a smooth transition be- 
tween the first and the second fields of view; 
and e) after the last stage of the compression or 
expansion process has been completed, sub- 
stituting the picture generated thereby with the 
picture as seen by the picture acquisition 
means of the second field of view. 
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(b) 
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The present invention relates to a method and ap- 
paratus for smoothing out stepwise changes of field 
of view. More particularly, the invention relates to 
electronically generated pictures generated by elec- 
tro-optical picture acquisition means. 5 

Observation systems are well known in the art, 
particularly for military and surveillance uses. They 
normally comprise optical devices, such as a camera, 
mounted on a platform, which can be manned or un- 
manned. The camera scans the area of interest, eith- 10 
er automatically or as directed by the operator, and 
the images collected by it are relayed to a screen, 
where they are viewed by the operator. One such ob- 
servation system is described in an article by David 
J. Busse & Kevin G. King [Forward Observation Re- 15 
mote Target Acquisition System (FORTAS), "Unman- 
ned Systems", Fall 1992, pp. 14-17], which describes 
one type of construction and related uses. 

Normally, the operator scans the area of interest 
and wishes to view it with a wide field of view. How- 20 
ever, when an object of interest appears on the 
screen, he wishes to zoom in to view it and its sur- 
roundings at an enlarged size. After his inspection of 
the object is completed, he wishes to zoom out, to re- 
turn to a wider f ield of view. Zooming can, of course, 25 
be effected as in movie cameras, by providing contin- 
uous zoom systems comprising a plurality of lenses 
and fine mechanics. However, such systems are ex- 
pensive, their resolution is a compromise between 
conflicting parameters, and they are sensitive to field 30 
conditions, where most of the observation systems 
are used, thus reducing their reliability. Furthermore, 
the operator of such systems is normally interested in 
panoramic views (wide field) and in enlarged pictures 
of specific objects (narrow field), but his interest in in- 35 
termediate fields of view is very limited. For these 
reasons, normal observation systems are made so 
that the picture acquisition devices (cameras) switch 
between fields of view stepwise. This requires a more 
limited number of lenses and simpler and more reli- 40 
able mechanics, and the optical performance can be 
separately optimized for each set, and is therefore 
preferred. 

Unfortunately, there is a drawback to this solu- 
tion, which derives from the slow adjustment of the 45 
human senses to field changes. When the picture is 
switched on the screen from one field of view to an- 
other, the change is too sudden and the operator is 
disoriented until he becomes used to the new picture. 
This does not only comport a d iscomfort for the oper- 50 
ator, but also leads to a situation where there is no 
continuity in the observation of the operator, which 
substantially diminishes the effectiveness of his 
work. This is particularly severe when zooming in 
from a wider field of view, since then it is desired to 55 
follow a specific object closely and the sudden 
change in the dimensions of the object and of its sur- 
roundings render this task difficult. 



It is therefore clear that it would be highly desir- 
able to be able to overcome the abovementioned 
drawbacks of prior art systems, without the need for 
expensive and complicated optical and mechanical 
systems. 

It is an object of the present invention to provide 
a method and apparatus which at least alleviate the 
aforementioned problem, and which render the tran- 
sition of the picture among fields of view smooth and 
comfortable for the operator. 

It is another object of the invention to provide an 
apparatus which is relatively inexpensive and simple 
to operate. Other objects of the invention will become 
apparent as the description proceeds. 

The method of smoothing out stepwise changes 
of field of view between a first and a second field, ac- 
cording to the invention, in an observation system 
adapted to operate between at least two fields of 
view, the said observation system having picture ac- 
quisition means adapted to each field of view and dis- 
play means for displaying the picture, comprises the 
steps of: 

a. selecting a reference point in the picture to be 
observed in a first field of view; 

b. digitizing the part of the picture appearing in 
the first field of view which it is desired to see af- 
ter the step change, and transmitting the digi- 
tized data to data processing means; 

c. processing the said digitized data to compress 
or expand each pixel by a factor equal to or less 
then about the difference between the fields of 
view, the said compression or expansion being 
carried out sequentially in a plurality of steps; 

d. at each stage of the compression or expansion 
process, displaying the partially compressed or 
partially expanded picture, so as to create the 
feeling of a smooth transition between the first 
and the second fields of view; and 

e. after the last stage of the compression or ex- 
pansion process has been completed, substitut- 
ing the picture generated thereby with the picture 
as seen by the picture acquisition means of the 
second field of view. 

The reference point referred to above is prefer- 
ably the center of the picture, since usually the optical 
axes of the two fields of view are coalligned. The tim- 
ing of the picture substitution can be dictated by a 
number of considerations, and it can be a fixed value 
or can be selected at will by the operator. For in- 
stance, if the size ratio between the first and the last 
real time pictures is m, after the picture has been 
electronically scaled (up or down) by a factor of Vm 
the final real time picture, as seen by the picture ac- 
quisition means, can be substituted. This may be 
done, for instance, when scaling down from a unit val- 
ue size, when the size has reached the value Vm, and 
when scaling up from a size of Vm, when the size has 
reached a value of m. 
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Accordingly, two separate modes of operation 
can be used in normal operation: 1) a "smooth" meth- 
od, whereby the picture is scaled by equal small in- 
crements, and the final real time picture is substitut- 
ed when its size is substantially equal to - or 1-2 in- 5 
crements away from - the last electronically-generat- 
ed picture; and 2) a "jump" method, whereby the pic- 
ture is scaled by small increments until its size is re- 
moved from that of the final, real time picture, by a 
factor which is substantially greater than the said 10 
small increments, and then the picture is substituted. 

According to a preferred embodiment of the in- 
vention, the stepwise change is effected by switching 
from a first to a second lens or set of lenses, one of 
the said lenses or set of lenses providing a picture en- 15 
larged by a given factor, as compared to the other lens 
or set of lenses. Of course, more than two positions 
may exists in each picture acquisition system, and all 
that is said with reference to two positions applies, 
mutatis mutandis, to any additional or intermediate 20 
position. Furthermore, the method of the invention is 
not limited to any specific method of switching be- 
tween different fields of view, and can be used with 
any suitable method. For instance, the method can be 
applied also when switching between different cam- 25 
eras having fixed fields of view, which are directed to 
the same center of picture, to smooth out the transi- 
tion between such different cameras. For the sake of 
simplicity, however, in the following description refer- 
ence will be made mostly to conventional systems 30 
having multifocal-length cameras. 

As stated, the method of the invention can be 
used both when zooming in and when zooming out. 
When the stepwise change includes zooming in from 
a wider field of view to a narrower field of view, the pic- 35 
ture expansion process comprises the steps of: 

A. selecting a reference point positioned within 
the picture to be enlarged, typically the center of 
the picture; 

B. selecting a frame within the picture, which en- 40 
compasses the area of the picture corresponding 

to the enlargement factor between the first and 
the second field; 

C. selecting an enlargement factor for each step; 

D. generating from each pixel or each group of 45 
pixels one or more synthetic pixel(s) so that the 
ratio of the combined area of the original pixel and 

of the pixel(s) so generated, to the area of the 
original pixel, equals the enlargement factor; 

E. displaying the enlarged frame; so 

F. repeating steps A through E until the dimen- 
sions of the selected frame are the same or 
slightly below those of the limits of the display 
means; and 

G. substituting the picture generated by the en- 55 
largement process with the picture as seen by the 
picture acquisition means of the enlarged field of 
view. 



The synthetic pixels can be generated from exist- 
ing pixels by a number of methods known in the art 
by extrapolation and interpolation, and therefore this 
step, which is clear to the skilled person, is not dis- 
cussed here in detail, for the sake of brevity. For in- 
stance, picture processing can be effected using 
standard elements such as the TMC2301 - CMOS Im- 
age Resampling Sequencer and the TMC2246 - 
CMOS Image Filter, (manufactured by TRW Inc., 
U.S. A). 

Of course, the enlargement factor will determine 
the number of steps required, which in turn will deter- 
mine the smoothness of change of the picture on the 
screen. This factor can be determined in a variety of 
ways, and will substantially be selected on the basis 
of human engineering considerations, so as to render 
the use of the system comfortable for the operator. 

The substitution of the real enlarged picture 
viewed by the camera can be effected either when the 
computer-generated enlarged picture has reached 
the size of the true large picture, or slightly before, so 
as to render the transition as natural as possible. It 
should be understood, however, that even if the sub- 
stitution is effected earlier in the process, the result 
is still an improved one, because the eye of the oper- 
ator will be obliged to effect the transition between a 
picture which is closer in dimensions and boarders to 
the enlarged one than was the original picture. 

When the stepwise change includes zooming out 
from a narrower field of view to a wider field of view, 
the picture compression process comprises the steps 
of: 

I. selecting a reference point in the picture to be 
compressed; 

II. selecting as the selected frame the boarders 
of the display means; 

III. selecting a compression factor for each step; 

IV. compressing each pixel by the compression 
factor; 

V. displaying the compressed picture, leaving pix- 
els located between the compressed frame and 
the frame of the display means blank; 

VI. repeating steps I through V until the frame of 
the picture has been compressed by the com- 
pression factor or slightly less; and 

VII. substituting the picture generated by the 
compression process with the picture as seen by 
the picture acquisition means of the reduced field 
of view. 

Whether the final transition is made by the 
smooth, jump or mixed method can be chosen at will 
also in this case, as discussed above. 

The difference between the enlargement and the 
compression processes resides mainly in the fact that 
while compressing the quality of the picture can be 
maintained, since no approximate data is to be gen- 
erated for the new pixels, and in that the frame of the 
picture shrinks, leaving empty (or black) boarders 
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which will be filled only when the real picture is sub- 
stituted. 

As discussed above, the compression of the pic- 
ture can be effected by any suitable method and 
therefore is not discussed in detail, for the sake of 5 
brevity. 

The invention also encompasses apparatus for 
smoothing out stepwise changes of field of view be- 
tween a first and a second field, in a multi-field of view 
observation system having picture acquisition means 10 
adapted to each field of view and display means for 
displaying the picture, comprising: 

1 - digitizing means to digitize the part of the pic- 
ture appearing in the first field of view which it is 
desired to see after the step change; 15 

2 - data transmission means, to transmit digitized 
data to data processing means and therefrom to 
the display means; 

3 - data processing means, to process the said 
digitized data, to compress or expand each pixel 20 
by a predetermined, the said compression or ex- 
pansion being carried out sequentially in a plur- 
ality of steps; and 

4 - control means to substitute the picture gener- 
ated by the data processing means with the pic- 25 
ture as seen by the picture acquisition means. 

As will be appreciated by the skilled person, the 
quality of the picture obtained during zooming in de- 
creases with each step, since the number of details 
per unit area decreases. However, this fact does not 30 
detract from the advantages of the invention, since 
the period of time during which quality is reduced is 
very brief (of the order of 1-2 seconds), and since the 
desired effect of providing a feeling of smooth transi- 
tion is achieved even with a somewhat reduced qual- 35 
ity of the picture. 

The above and other characteristics and advan- 
tages of the invention will be further illustrated 
through the following illustrative and non-limitative 
examples of embodiments of the invention. 40 

Fig. 1 illustrates the passage between two fields 

of view, according to the devices of the known art, 

when zooming in; 

Fig. 2 illustrates the same operation as in Fig. 1, 

but when operating according to one embodiment 45 

of the invention; 

Fig. 3 illustrates the passage between two fields 
of view, according to the devices of the known art, 
when zooming out; 

Fig. 4 illustrates the same operation as in Fig. 3, so 
but when operating according to one embodiment 
of the invention; 

The following examples illustrate the invention, 
but are not intended to be limitative. 

55 



Example 1 
Zooming In 

Fig. 1 shows a building being surveilied (Fig. 
1 (a)). The operator wishes, at one time, to zoom in at 
the center of the bottom of the picture, to obtain a 
close view of the man walking away from the building. 
Before he does so, the operator will normally position 
the point of interest at or near the center of the picture. 
In a device operating according to the prior art, the 
transition will be as illustrated in Fig. 1, with a sharp 
change from Fig. 1(a) to Fig. 1(b). 

When operating according to one embodiment of 
the invention, on the other hand, the change is ob- 
tained gradually. This is illustrated by Fig. 2. Fig. 2(a) 
is the same picture seen on the screen, as obtained 
in real time by the picture acquisition system, and cor- 
responds to Fig. 1(a). Fig. 2(a) is digitized and en- 
larged sequentially, to produce Figs. 2(b) through 
2(e), during which time the operator does not see a 
real time picture, but the enlargement of the picture 
of Fig. 2(a). When the enlargement (Fig. 2(e)) ap- 
proaches that of the real time picture of the second 
field of view, the apparatus switches again to the real 
time picture of Fig. 1(a). 

Of course, Fig. 2 is presented in simplified form, 
the number of enlargements being limited and the en- 
largement factor being large (141%). However, when 
operating an actual device, the number of frames and 
the frequency of change will be adapted to obtain a 
change which is optimal both from the point of view 
of smoothness and of time, since it is not desirable to 
keep the operator away from the real-time picture for 
too long an interval of time. 

As can be seen by going through Fig. 2, passing 
through a number of consecutive enlargements pro- 
vides a much easier adjustment of the eye than is ob- 
tained according to the known art. One can appreci- 
ate the improvement by closely scanning Fig. 2, se- 
quentially from Fig. 2(a) to Fig. 2(e), and comparing 
the feeling with that obtained by passing, at the same 
speed from Fig. 1(a) to Fig. 1(b). 

Example 2 

Zooming Out 

Zooming out is similar to zooming in, as far as the 
comfort of the operator is concerned, and the same 
general considerations hold true. However, there is a 
difference between the two, which will be explained 
below. 

For the sake of comparison, the same picture 
which was used for illustrating the process of Exam- 
ple 1 is used also here. Zooming out involves the in- 
verse process, viz., the passage from Fig. 3(a) to Fig. 
3(b), which illustrates the operation of prior art appa- 
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rat us. 

Fig. 4 illustrates the zooming out operation ac- 
cording to one embodiment of the invention. Fig. 4(a) 
is the real-time picture, which is digitized and re- 
duced. Figs. 4(b) through 4(d) are computer-generat- 5 
ed reductions of Fig. 4(a). Fig. 4(d) has the approxi- 
mate dimensions of the real-time picture of the sec- 
ond (wider) field of view, and therefore the apparatus 
switches from it to the real-time picture of Fig. 4(e). 

The difference between zooming in and zooming 10 
out is apparent from Fig. 4. When zooming out the 
only available picture is only fraction of the next field 
of view, so that its reduction leads to the generation 
of an empty frame around it, as seen in the figure, 
nevertheless, passing from the correctly sized pic- 15 
ture of Fig. 4(d), although it is only a partial picture, 
to the real-time picture of Fig. 4(e) provides an easier 
transition than the extreme jump between the two 
real-time pictures of Fig. 3. 

It should further be noted that it is possible at 20 
least partially to overcome the drawback of the empty 
frame, by extrapolating the surroundings of the 
shrinking picture, to fill the empty frame with a back- 
ground which is in harmony with the picture, e.g„ by 
filling the empty areas with pixels having the same 25 
color intensity as the average intensity of their sur- 
roundings. This can be effected by known algorithms, 
or by any suitable method the development of which 
is within the scope of the skilled engineer. 

All the above description and examples have 30 
been given for the purpose of illustration and are not 
intended to limit the invention in any way. Many 
changes can be effected in the invention. For in- 
stance, different algorithms can be employed for ex- 
panding or compressing the pixels, and different 35 
means to display, process or transmit the data can be 
used. Furthermore, different observation systems, 
having different and/or additional elements, can be 
exploited, all without exceeding the scope of the in- 
vention. 40 



Claims 

1. A method of smoothing out stepwise changes of 45 
field of view between a first and a second field, 
in an observation system adapted to operate be- 
tween at least two fields of view, the said obser- 
vation system having picture acquisition means 
adapted to each field of view and display means so 
for displaying the picture, comprising the steps of: 

a. selecting a reference point in the picture to 
be observed in a first field of view; 

b. digitizing the part of the picture appearing 

in the first field of view which it is desired to 55 
see after the step change, and transmitting 
the digitized data to data processing means; 

c. processing the said digitized data to com- 



press or expand each pixel by a factor equal 
to or less then about the difference between 
the fields of view, the said compression or ex- 
pansion being carried out sequentially in a 
plurality of steps; 

d. at each stage of the compression or expan- 
sion process, displaying the partially com- 
pressed or partially expanded picture, so as to 
create the feeling of a smooth transition be- 
tween the first and the second fields of view; 
and 

e. after the last stage of the compression or 
expansion process has been completed, sub- 
stituting the picture generated thereby with 
the picture as seen by the picture acquisition 
means of the second field of view. 

2. A method according to claim 1 , wherein the step- 
wise change is effected by switching from a first 
to a second lens or set of lenses, one of the said 
lenses or set of lenses providing a picture en- 
larged by a given factor, as compared to the other 
lens or set of lenses. 

3. A method according to claim 1 or 2, wherein the 
stepwise change includes zooming in from a wid- 
er field of view to a narrower field of view, the pic- 
ture expansion process comprising the steps of: 

A. selecting a reference point positioned with- 
in the picture to be enlarged, typically the cen- 
ter of the picture; 

B. selecting a frame within the picture, which 
encompasses the area of the picture corre- 
sponding to the enlargement factor between 
the first and the second field; 

C. selecting an enlargement factor for each 
step; 

D. generating from each pixel or each group 
of pixels one or more synthetic pixel(s) so that 
the ratio of the combined area of the original 
pixel and of the pixel(s) so generated, to the 
area of the original pixel, equals the enlarge- 
ment factor; 

E. displaying the enlarged frame; 

F. repeating steps Athrough E until the dimen- 
sions of the selected frame are the same or 
slightly below those of the limits of the display 
means; and 

G. substituting the picture generated by the 
enlargement process with the picture as seen 
by the picture acquisition means of the en- 
larged field of view. 

4. A method according to claim 1 or 2, wherein the 
stepwise change includes zooming out from a 
narrower field of view to a wider field of view, the 
picture compression process comprising the 
steps of: 
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I. selecting a reference point in the picture to 
be compressed; 

II. selecting as the selected frame the board- 
ers of the display means; 

III. selecting a compression factor for each 5 
step; 

IV. compressing each pixel by the compres- 
sion factor; 

V. displaying the compressed picture, leaving 
pixels located between the compressed 10 
frame and the frame of the display means 
blank; 

VI. repeating steps I through V until the frame 
of the picture has been compressed by the 
compression factor or slightly less; and 15 

VII. substituting the picture generated by the 
compression process with the picture as seen 
by the picture acquisition means of the re- 
duced field of view. 

20 

5. Apparatus for smoothing out stepwise changes of 
field of view between a first and a second field, 
in a multi-field of view observation system having 
picture acquisition means adapted to each field 

of view and display means for displaying the pic- 25 
ture, comprising: 

1 - digitizing means to digitize the part of the 
picture appearing in the first field of view 
which it is desired to see after the step 
change; 30 

2 - data transmission means, to transmit digi- 
tized data to data processing means and 
therefrom to the display means; 

3 - data processing means, to process the 

said digitized data, to compress or expand 35 
each pixel by a predetermined, the said com- 
pression or expansion being carried out se- 
quentially in a plurality of steps; and 

4 - control means to substitute the picture 
generated by the data processing means with 40 
the picture as seen by the picture acquisition 
means. 

6. A method of changing a field of view in an obser- 
vation system comprising the steps of: 45 

selecting an image in a first field of view; 

processing a representation of the image 
so as to compress or to expand the image in a se- 
quence of steps; 

at each step of the processing displaying so 
the partially compressed or partially expanded 
image; and 

displaying the compressed or expanded 
image in a second field of view. 

55 

7. An apparatus for changing a field of view in an ob- 
servation system comprising: 

means for selecting an image in a f irstf ield 



of view; 

means for processing a representation of 
the image so as to compress or to expand the im- 
age in a sequence of steps; 

means for displaying the partially com- 
pressed or partially expanded image at the end 
of each step; and 

means for displaying the compressed or 
expanded image in a second field of view. 
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